Channelling the force of audit and feedback : averting the dark side

Funding EMD is funded through a personal fellowship from the Healthcare Improvement Studies Institute, supported by the Health Foundation’s grant to the University of Cambridge. JMG holds a Canada Research Chair in Health Knowledge Transfer and Uptake. NMI holds a Canada Research Chair in Implementation of Evidence-based PracticePeer reviewedPostprin

Feedback GAP : study protocol for a cluster-randomized trial of goal setting and action plans to increase the effectiveness of audit and feedback interventions in primary care

Peer reviewedPublisher PD

Standardising Costs or Standardising Care? Qualitative Evaluation of the Implementation and Impact of a Hospital Funding Reform in Ontario, Canada

Background  Since 2011, the Government of Ontario, Canada, has phased in hospital funding reforms hoping to encourage standardised, evidence-based clinical care processes to both improve patient outcomes and reduce system costs. One aspect of the reform – quality-based procedures (QBPs) – replaced some of each hospital’s global budget with a pre-set price per episode of care for patients with specific diagnoses or procedures. The QBP initiative included publication and dissemination of a handbook for each of these diagnoses or procedures, developed by an expert technical group. Each handbook was intended to guide hospitals in reducing inappropriate variation in patient care and cost by specifying an evidence-based episode of care pathway. We explored whether, how and why hospitals implemented these episode of care pathways in response to this initiative. Methods  We interviewed key informants at three levels in the healthcare system, namely individuals who conceived and designed the QBP policy, individuals and organisations supporting QBP adoption, and leaders in five case-study hospitals responsible for QBP implementation. Analysis involved an inductive approach, incorporating framework analysis to generate descriptive and explanatory themes from data. Results  The 46 key informants described variable implementation of best practice episode of care pathways across QBPs and across hospitals. Handbooks outlining evidence-based clinical pathways did not address specific barriers to change for different QBPs nor differences in hospitals’ capacity to manage change. Hospitals sometimes found it easier to focus on containing and standardising costs of care than on implementing standardised care processes that adhered to best clinical practices. Conclusion  Implementation of QBPs in Ontario’s hospitals depended on the interplay between three factors, namely complexity of changes required, internal capacity for organisational change, and availability and appropriateness of targeted external facilitators and supports to manage change. Variation in these factors across QBPs and hospitals suggests the need for more tailored and flexible implementation supports designed to fit all elements of the policy, rather than one-size-fits-all handbooks alone. Without such supports, hospitals may enact quick fixes aimed mainly at preserving budgets, rather than pursue evidence- and value-based changes in care management. Overestimating hospitals’ change management capacity increases the risk of implementation failure

Analisis dan Perancangan Sistem Akuntansi dengan Model Driven Development (MDD) Pada Konveksi Anemarie

Informasi Akuntansi merupakan salah satu alat untuk mengambil keputusan dalam perusahaan.Sistem Informasi Akuntansi dapat memberikan kemudahan dalam menghasilkan informasi yang akurat, tepat waktu dapat dipahami dan teruji.Selain itu, sistem informasi akuntansi dapat memudahkan siklus operasional perusahaan baik dari pembelian, produksi, sampai penjualan.Maka dari uraian itu, peneliti ingin menganalisis dan merancang sistem informasi akuntansi pada usaha yang tidak memiliki sistem informasi akuntansi dan masih melakukan pencatatan secara manual. Peneliti menggunakan data sistem akuntansi Konveksi Anemarie periode April 2017 dan Model Driven Development untuk merancang Sistem Informasi Akuntansi konveksi Anemarie. Hasil pengembangan Sistem Informasi Akuntansi dengan Model Driven Development ini ialah Desain Model Data dengan Entity Relathionship diagram baik secara keseluruhan maupun per subsistem, Desain model Proses dengan Data Flow Diagram, dan desain model output dengan pembuatan interface dari form yang dibutuhka

Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals

Background: Audit and feedback (A&F) is among the most widely used implementation strategies, providing healthcare professionals with summaries of their practice performance to prompt behaviour change and optimize care. Wide variability in effectiveness of A&F has spurred efforts to explore why some A&F interventions are more effective than others. Unpacking the variability of the content of A&F interventions in terms of their component behaviours change techniques (BCTs) may help advance our understanding of how A&F works best. This study aimed to systematically specify BCTs in A&F interventions targeting healthcare professional practice change. / Methods: We conducted a directed content analysis of intervention descriptions in 287 randomized trials included in an ongoing Cochrane systematic review update of A&F interventions (searched up to June 2020). Three trained researchers identified and categorized BCTs in all trial arms (treatment & control/comparator) using the 93-item BCT Taxonomy version 1. The original BCT definitions and examples in the taxonomy were adapted to include A&F-specific decision rules and examples. Two additional BCTs (‘Education (unspecified)’ and ‘Feedback (unspecified)’) were added, such that 95 BCTs were considered for coding. / Results: In total, 47/95 BCTs (49%) were identified across 360 treatment arms at least once (median = 5.0, IQR = 2.3, range = 129 per arm). The most common BCTs were ‘Feedback on behaviour’ (present 89% of the time; e.g. feedback on drug prescribing), ‘Instruction on how to perform the behaviour’ (71%; e.g. issuing a clinical guideline), ‘Social comparison’ (52%; e.g. feedback on performance of peers), ‘Credible source’ (41%; e.g. endorsements from respected professional body), and ‘Education (unspecified)’ (31%; e.g. giving a lecture to staff). A total of 130/287 (45%) control/comparator arms contained at least one BCT (median = 2.0, IQR = 3.0, range = 0–15 per arm), of which the most common were identical to those identified in treatment arms. / Conclusions: A&F interventions to improve healthcare professional practice include a moderate range of BCTs, focusing predominantly on providing behavioural feedback, sharing guidelines, peer comparison data, education, and leveraging credible sources. We encourage the use of our A&F-specific list of BCTs to improve knowledge of what is being delivered in A&F interventions. Our study provides a basis for exploring which BCTs are associated with intervention effectiveness. / Trial registrations: N/A

Qualitative Analysis of the Dynamics of Policy Design and Implementation in Hospital Funding Reform

Background  As in many health care systems, some Canadian jurisdictions have begun shifting away from global hospital budgets. Payment for episodes of care has begun to be implemented. Starting in 2012, the Province of Ontario implemented hospital funding reforms comprising three elements: Global Budgets; Health Based Allocation Method (HBAM); and Quality-Based Procedures (QBP). This evaluation focuses on implementation of QBPs, a procedure/diagnosis-specific funding approach involving a pre-set price per episode of care coupled with best practice clinical pathways. We examined whether or not there was consensus in understanding of the program theory underpinning QBPs and how this may have influenced full and effective implementation of this innovative funding model. Methods  We undertook a formative evaluation of QBP implementation. We used an embedded case study method and in-depth, one-on-one, semi-structured, telephone interviews with key informants at three levels of the health care system: Designers (those who designed the QBP policy); Adoption Supporters (organizations and individuals supporting adoption of QBPs); and Hospital Implementers (those responsible for QBP implementation in hospitals). Thematic analysis involved an inductive approach, incorporating Framework analysis to generate descriptive and explanatory themes that emerged from the data. Results  Five main findings emerged from our research: (1) Unbeknownst to most key informants, there was neither consistency nor clarity over time among QBP designers in their understanding of the original goal(s) for hospital funding reform; (2) Prior to implementation, the intended hospital funding mechanism transitioned from ABF to QBPs, but most key informants were either unaware of the transition or believe it was intentional; (3) Perception of the primary goal(s) of the policy reform continues to vary within and across all levels of key informants; (4) Four years into implementation, the QBP funding mechanism remains misunderstood; and (5) Ongoing differences in understanding of QBP goals and funding mechanism have created challenges with implementation and difficulties in measuring success. Conclusions  Policy drift and policy layering affected both the goal and the mechanism of action of hospital funding reform. Lack of early specification in both policy goals and hospital funding mechanism exposed the reform to reactive changes that did not reflect initial intentions. Several challenges further exacerbated implementation of complex hospital funding reforms, including a prolonged implementation schedule, turnover of key staff, and inconsistent messaging over time. These factors altered the trajectory of the hospital funding reforms and created confusion amongst those responsible for implementation. Enacting changes to hospital funding policy through a process that is transparent, collaborative, and intentional may increase the likelihood of achieving intended effects

Interventions to increase attendance for diabetic retinopathy screening

BACKGROUND: Despite evidence supporting the effectiveness of diabetic retinopathy screening (DRS) in reducing the risk of sight loss, attendance for screening is consistently below recommended levels.OBJECTIVES: The primary objective of the review was to assess the effectiveness of quality improvement (QI) interventions that seek to increase attendance for DRS in people with type 1 and type 2 diabetes.Secondary objectives were:To use validated taxonomies of QI intervention strategies and behaviour change techniques (BCTs) to code the description of interventions in the included studies and determine whether interventions that include particular QI strategies or component BCTs are more effective in increasing screening attendance;To explore heterogeneity in effect size within and between studies to identify potential explanatory factors for variability in effect size;To explore differential effects in subgroups to provide information on how equity of screening attendance could be improved;To critically appraise and summarise current evidence on the resource use, costs and cost effectiveness.SEARCH METHODS: We searched the Cochrane Library, MEDLINE, Embase, PsycINFO, Web of Science, ProQuest Family Health, OpenGrey, the ISRCTN, ClinicalTrials.gov, and the WHO ICTRP to identify randomised controlled trials (RCTs) that were designed to improve attendance for DRS or were evaluating general quality improvement (QI) strategies for diabetes care and reported the effect of the intervention on DRS attendance. We searched the resources on 13 February 2017. We did not use any date or language restrictions in the searches.SELECTION CRITERIA: We included RCTs that compared any QI intervention to usual care or a more intensive (stepped) intervention versus a less intensive intervention.DATA COLLECTION AND ANALYSIS: We coded the QI strategy using a modification of the taxonomy developed by Cochrane Effective Practice and Organisation of Care (EPOC) and BCTs using the BCT Taxonomy version 1 (BCTTv1). We used Place of residence, Race/ethnicity/culture/language, Occupation, Gender/sex, Religion, Education, Socioeconomic status, and Social capital (PROGRESS) elements to describe the characteristics of participants in the included studies that could have an impact on equity of access to health services.Two review authors independently extracted data. One review author entered the data into Review Manager 5 and a second review author checked them. Two review authors independently assessed risks of bias in the included studies and extracted data. We rated certainty of evidence using GRADE.MAIN RESULTS: We included 66 RCTs conducted predominantly (62%) in the USA. Overall we judged the trials to be at low or unclear risk of bias. QI strategies were multifaceted and targeted patients, healthcare professionals or healthcare systems. Fifty-six studies (329,164 participants) compared intervention versus usual care (median duration of follow-up 12 months). Overall, DRS attendance increased by 12% (risk difference (RD) 0.12, 95% confidence interval (CI) 0.10 to 0.14; low-certainty evidence) compared with usual care, with substantial heterogeneity in effect size. Both DRS-targeted (RD 0.17, 95% CI 0.11 to 0.22) and general QI interventions (RD 0.12, 95% CI 0.09 to 0.15) were effective, particularly where baseline DRS attendance was low. All BCT combinations were associated with significant improvements, particularly in those with poor attendance. We found higher effect estimates in subgroup analyses for the BCTs 'goal setting (outcome)' (RD 0.26, 95% CI 0.16 to 0.36) and 'feedback on outcomes of behaviour' (RD 0.22, 95% CI 0.15 to 0.29) in interventions targeting patients, and 'restructuring the social environment' (RD 0.19, 95% CI 0.12 to 0.26) and 'credible source' (RD 0.16, 95% CI 0.08 to 0.24) in interventions targeting healthcare professionals.Ten studies (23,715 participants) compared a more intensive (stepped) intervention versus a less intensive intervention. In these studies DRS attendance increased by 5% (RD 0.05, 95% CI 0.02 to 0.09; moderate-certainty evidence).Fourteen studies reporting any QI intervention compared to usual care included economic outcomes. However, only five of these were full economic evaluations. Overall, we found that there is insufficient evidence to draw robust conclusions about the relative cost effectiveness of the interventions compared to each other or against usual care.With the exception of gender and ethnicity, the characteristics of participants were poorly described in terms of PROGRESS elements. Seventeen studies (25.8%) were conducted in disadvantaged populations. No studies were carried out in low- or middle-income countries.AUTHORS' CONCLUSIONS: The results of this review provide evidence that QI interventions targeting patients, healthcare professionals or the healthcare system are associated with meaningful improvements in DRS attendance compared to usual care. There was no statistically significant difference between interventions specifically aimed at DRS and those which were part of a general QI strategy for improving diabetes care. This is a significant finding, due to the additional benefits of general QI interventions in terms of improving glycaemic control, vascular risk management and screening for other microvascular complications. It is likely that further (but smaller) improvements in DRS attendance can also be achieved by increasing the intensity of a particular QI component or adding further components.</p

Understanding context in knowledge translation: a concept analysis study protocol

AimTo conduct a concept analysis of clinical practice contexts (work environments) that facilitate or militate against the uptake of research evidence by healthcare professionals in clinical practice. This will involve developing a clear definition of context by describing its features, domains and defining characteristics.BackgroundThe context where clinical care is delivered influences that care. While research shows that context is important to knowledge translation (implementation), we lack conceptual clarity on what is context, which contextual factors probably modify the effect of knowledge translation interventions (and hence should be considered when designing interventions) and which contextual factors themselves could be targeted as part of a knowledge translation intervention (context modification).DesignConcept analysis.MethodsThe Walker and Avant concept analysis method, comprised of eight systematic steps, will be used: (1) concept selection; (2) determination of aims; (3) identification of uses of context; (4) determination of defining attributes of context; (5) identification/construction of a model case of context; (6) identification/construction of additional cases of context; (7) identification/construction of antecedents and consequences of context; and (8) definition of empirical referents of context. This study is funded by the Canadian Institutes of Health Research (January 2014).DiscussionThis study will result in a much needed framework of context for knowledge translation, which identifies specific elements that, if assessed and used to tailor knowledge translation activities, will result in increased research use by nurses and other healthcare professionals in clinical practice, ultimately leading to better patient care.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/111196/1/jan12574.pd

No more 'business as usual' with audit and feedback interventions: towards an agenda for a reinvigorated intervention

Background: Audit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key ‘active ingredients.’ Discussion: Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the ‘business as usual’ approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature. Summary: We offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness